Electronic device for speech security with less environmental sound distortion and operating method thereof

ABSTRACT

An electronic device and an operating method thereof according to various example embodiments may be configured to acquire video data and audio data, to scramble audio data of a time interval (ΔT) in non-time order, and to store the video data and the scrambled audio data together. According to an example embodiment, the time interval (ΔT) may be fixed to be the same with respect to continuous audio data. According to another example embodiment, the time interval (ΔT) may vary using a function of receiving an input of a secret key and order and outputting a unique value, such as a Hash-based Message Authentication Codes (HMAC)-based One-time Password (HOTP) algorithm.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.16/984,503, filed on Aug. 4, 2020, which is based upon and claims thebenefit of priority from the prior Korean Patent Application No.10-2020-0095382, filed on Jul. 30, 2020 and Korean Patent ApplicationNo. 10-2019-0094700 filed Aug. 5, 2019, the entire contents of which areincorporated herein by reference.

TECHNICAL FIELD

Various example embodiments relate to an electronic device for speechscrambling and an operating method thereof.

RELATED ART

In general, an electronic device provides various services by performingvarious functions in combination. For example, the electronic device maycollect each of video data and audio data about a surroundingenvironment and may record the video data and the audio data together,such that a surrounding situation at a specific time may be graspedlater. Here, the audio data may unintentionally include speech of aperson. Therefore, contents of undesired speech may be disclosed whenthe audio data is reproduced to grasp the surrounding situation.

A privacy issue may be solved by scrambling speech. However, in a casein which the environmental sound is important, it is difficult toscramble audio data such that only contents of speech may not beperceived and the environmental sound may be perceived since a frequencyband of the environmental sound and a frequency band of the speechwidely overlap.

DETAILED DESCRIPTION Subject

Various example embodiments provide an electronic device that mayscramble audio data such that contents of speech of a user may not beperceived and the environmental sound may be perceived from audio datainput to a microphone, and an operating method thereof.

Solution

An electronic device according to various example embodiments mayinclude a camera module configured to collect a video signal, an inputmodule configured to collect an audio signal while the video signal isbeing collected, and a processor configured to connect to the cameramodule and the input module. The processor may be configured to acquirevideo data and audio data, scramble the audio data in non-time order,and store the video data and the scrambled audio data together.

An operating method of an electronic device according to various exampleembodiments may include acquiring video data and audio data, scramblingthe audio data in non-time order, and storing the video data and thescrambled audio data together.

Effect

According to various example embodiments, an electronic device mayscramble audio data such that contents of speech of a user may not beperceived and the environmental sound may be perceived from audio data.The electronic device may scramble the audio data in non-time order,thereby making contents of speech become ambiguous in the audio data.Therefore, when the electronic device or an external device reproducesvideo data and audio data later, contents according to speech of theaudio data may not be perceived by a listener. Meanwhile, theenvironmental sound is less sensitive to time order compared to speechand does not include contents according to the time order. Therefore, aslong as a frequency does not significantly vary, the environmental soundis still perceptible by the listener although scrambled to change thetime order. As described above, although speech of a speaker andsurrounding noise are simultaneously input to audio data, the presentdisclosure may scramble the input audio data in non-time order using acharacteristic that noise is less sensitive to time than speech, suchthat the noise may be perceived by a third party and the speech of thespeaker may not be perceived by the third party.

Here, the electronic device may scramble audio data of a time interval(ΔT). According to an example embodiment, the time interval (ΔT) may befixed to be the same with respect to continuous audio data. According toanother example embodiment, the time interval (ΔT) may vary using afunction of receiving a secret key and a counter and outputting a uniquevalue, such as a Hash-based Message Authentication Codes (HMAC)-basedOne-time Password (HOTP) algorithm. In this case, for descrambling thescrambled audio data such that contents of speech as well asenvironmental sound may be perceived, a time interval (ΔT) in whichscrambling in non-time order is performed at a corresponding audio datalocation is found through a function and a secret key used to determinethe same and audio samples within the corresponding time interval (ΔT)need to be returned from non-time order to time order.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram illustrating an electronic device according tovarious example embodiments.

FIG. 2A is a diagram illustrating a processor for scrambling audio dataof FIG. 1.

FIG. 2B is a diagram describing an example of a scrambling module ofFIG. 2A.

FIG. 3 illustrates audio data acquired at an electronic device accordingto various example embodiments.

FIGS. 4A and 4B illustrate audio data processed at an electronic deviceaccording to various example embodiments.

FIG. 5 illustrates a scrambling module of FIG. 2A.

FIG. 6 is a flowchart illustrating an operating method of an electronicdevice according to various example embodiments.

FIG. 7A is a diagram illustrating a processor for descrambling scrambledaudio data of FIG. 1.

FIG. 7B is a diagram describing an example of a descrambling module ofFIG. 7A.

FIG. 8 is a flowchart illustrating an operating method of an electronicdevice according to various example embodiments.

FIG. 9 illustrates a vehicle to which an electronic device according tovarious example embodiments is mounted.

FIG. 10 illustrates the electronic device of FIG. 9.

FIG. 11 is a diagram describing operations of a first electronic deviceconfigured to generate scrambled audio data, a server, and a secondelectronic device configured to descramble the scrambled audio dataaccording to various example embodiments of the present disclosure.

DETAILED DESCRIPTION TO CARRY OUT THE DISCLOSURE

Hereinafter, various example embodiments of the present specificationare described with reference to the accompanying drawings.

FIG. 1 is a diagram illustrating an electronic device 100 according tovarious example embodiments.

Referring to FIG. 1, the electronic device 100 according to variousexample embodiments may include at least one of a camera module 110, aconnection terminal 120, a communication module 130, an input module140, an output module 150, a sensor module 160, a memory 170, and aprocessor 180. In some example embodiments, at least one of componentsof the electronic device 100 may be omitted and at least one anothercomponent may be added. In some example embodiments, at least two of thecomponents of the electronic device 100 may be configured as a singleintegrated circuit. For example, the electronic device 100 may includeat least one of a black box, a smartphone, a mobile phone, a computer, alaptop computer, a digital broadcasting terminal, personal digitalassistants (PDA), a portable multimedia player (PMP), a tablet PC, agame console, a wearable device, an Internet of things (IoT) device, anda robot.

The camera module 110 may capture a video in the electronic device 100.Here, the camera module 110 may be provided at a predetermined positionof the electronic device 100 and may capture a video. Through this, thecamera module 110 may collect a video signal. For example, the cameramodule 110 may include at least one of a lens, at least one imagesensor, an image signal processor, and a flash.

The connection terminal 120 may physically connect to an external device102 in the electronic device 100. For example, the external device 102may include another electronic device. To this end, the connectionterminal 120 may include at least one connector. For example, theconnector may include at least one of a high-definition multimediainterface (HDMI) connector, a universal serial bus (USB) connector, asecure digital (SD) card connector, and an audio connector.

The communication module 130 may communicate with the external device102, 104 in the electronic device 100. The communication module 130 mayestablish a communication channel between the electronic device 100 andthe external device 102, 104 and may communicate with the externaldevice 102, 104 through the communication channel. Here, the externaldevice 102, 104 may include at least one of a satellite, a base station,a server, and another electronic device. The communication module 130may include at least one of a wired communication module and a wirelesscommunication module. The communication module 130 may connect to theexternal device 102 in a wired manner through the connection terminal120 and may communicate with the external device 102 in the wiredmanner. The wireless communication module may include at least one of anear field communication module and a far field communication module.The near field communication module may communicate with the externaldevice 102 through a near field communication scheme. For example, thenear field communication scheme may include at least one of Bluetooth,wireless fidelity (WiFi) direct, and infrared data association (IrDA).The far field communication module may communicate with the externaldevice 104 through a far field communication scheme. Here, the far fieldcommunication module may communicate with the external device 104 over anetwork 190. For example, the network 190 may include at least one of acellular network, the Internet, and a computer network, such as a localarea network (LAN) and a wide area network (WAN).

The input module 140 may receive an input of a signal to be used for atleast one component of the electronic device 100. The input module 140may receive, from a user, an instruction or data to be used for theprocessor 180 and may generate a signal. Here, the input module 140 maycollect an audio signal. For example, the input module 140 may includeat least one of a microphone, a mouse, and a keyboard. In some exampleembodiments, the input module 140 may include at least one of a touchcircuitry configured to detect a touch and a sensor circuitry configuredto measure magnitude of a force generated in response to the touch.

The output module 150 may output information of the electronic device100. The output module 150 may include at least one of a display moduleconfigured to visually output information and an audio output moduleconfigured to output information using an audio signal. For example, thedisplay module may include at least one of a display, a hologram device,and a projector. For example, the display module may be implemented as atouchscreen through being assembled to at least one of the touchcircuitry and the sensor circuitry of the input module 140. For example,an audio output module may include at least one of a speaker and areceiver.

The sensor module 160 may generate an electrical signal or a data valuecorresponding to an internal operation state (e.g., power ortemperature) or an external environmental state of the electronic device100. For example, the sensor module 160 may include at least one of aradar sensor, a light detection and ranging (LIDAR) sensor, a gesturesensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor,an acceleration sensor, a grip sensor, a proximity sensor, a colorsensor, an infrared (IR) sensor, a biometric sensor, a temperaturesensor, a humidity sensor, and an illumination sensor.

The memory 170 may store a variety of data used by at least onecomponent of the electronic device 100. For example, the memory 170 mayinclude at least one of a volatile memory and a non-volatile memory.Data may include at least one program and input data or output datarelated thereto. The program may be stored in the memory 170 as softwarethat includes at least one instruction and may include, for example, atleast one of an operating system (OS), middleware, and an application.

The processor 180 may control at least one component of the electronicdevice 100 by executing the program of the memory 170. Through this, theprocessor 180 may perform data processing or operation. Here, theprocessor 180 may execute an instruction stored in the memory 170. Theprocessor 180 may acquire video data through the camera module 110 andmay acquire audio data through the input module 140. The processor 180may store the video data and the audio data together. Here, theprocessor 180 may scramble the audio data. The audio data may include atleast one of speech of a person and environmental sound about asurrounding environment. For example, when the electronic device 100 ispresent within a vehicle, the environmental sound may include at leastone of horn sound, brake sound, turn indicator sound, fricative sound,and collision sound.

According to an example embodiment, the processor 180 may scramble audiodata within a predetermined time interval (ΔT) in non-time order. Whenthe audio data includes speech of the user and the environmental sound,the audio data is scrambled in non-time order and accordingly, contentsaccording to the speech become ambiguous in the audio data. Therefore,when playing the audio data later in the electronic device 100 or theexternal device 102, 104, the contents according to the speech of theaudio data may not be perceptible by a listener. Meanwhile, theenvironmental sound does not include contents sensitive to time order.Therefore, although the audio data is scrambled, the environmental soundis still perceptible by the listener.

According to another example embodiment, the processor 180 may scrambleaudio data within a varying time interval (ΔT). Here, to enhancescrambling in non-time order, the processor 180 may change the timeinterval (ΔT) for scrambling in non-time order using an algorithm thatoutputs unique numerical values based on a secret key, such as aHash-based Message Authentication Codes (HMAC)-based One-time Password(HOTP) algorithm. In this case, for descrambling the scrambled audiodata to perceive contents of speech as well as environmental sound inthe electronic device 100 or the external device 102, 104, a timeinterval (ΔT) in which scrambling in non-time order is performed at acorresponding audio data location is found through a function and asecret key used to determine the same and audio samples within thecorresponding time interval (ΔT) need to be returned from non-time orderto time order.

FIG. 2A is a diagram illustrating the processor 180 for scrambling audiodata of the electronic device 100 according to various exampleembodiments. FIG. 2B is a diagram describing an example of a scramblingmodule 240 of FIG. 2A. FIG. 3 illustrates audio data acquired at theelectronic device 100 according to various example embodiments. FIGS. 4Aand 4B illustrate audio data processed at the electronic device 100according to various example embodiments. FIG. 5 illustrates thescrambling module 240 of FIG. 2A.

Referring to FIG. 2A, the processor 180 may include at least one of avideo processing module 210, a video compression module 220, an audioprocessing module 230, a scrambling module 240, an audio compressionmodule 250, and a combination module 260. In some examples, at least oneof components of the processor 180 may be omitted and at least oneanother component may be added. In some examples, at least two of thecomponents of the processor 180 may be configured as a single integratedcircuit.

The video processing module 210 may process a video signal collectedthrough the camera module 110. Through this, the video processing module210 may acquire video data from the video signal. For example, the videoprocessing module 210 may include at least one of an image signalprocessor (ISP), an image processing engine (IPE), and an imageprocessing unit (IPU). The video processing module 120 may apply, to thevideo signal, at least one of geometric transformation, colorcorrection, color transformation, noise cancellation, and sharpening.

The video compression module 220 may compress video data.

The audio processing module 230 may process an audio signal collectedthrough the input module 140. Through this, the audio processing module230 may acquire audio data from the audio signal. Here, the audioprocessing module 230 may convert an analog audio signal to a digitalaudio data. To this end, the audio processing module 230 may include,for example, an analog-digital converter (ADC). In addition, the audioprocessing module 230 may additionally apply at least one of signalamplification and noise cancellation to the audio signal.

The scrambling module 240 may scramble audio data. According to anexample embodiment, the scrambling module 240 may scramble audio databased on a predetermined time interval (ΔT). According to anotherexample embodiment, the scrambling module 240 may scramble audio databased on a varying time interval (ΔT). The scrambling module 240 maychange the time interval (ΔT) for scrambling in non-time order using anone-time password (OTP) generation algorithm that outputs unique valuesgenerated based on a secret key, such as an HOTP algorithm, therebymaking it difficult to find out the corresponding time interval (ΔT) atany point in time. In this manner, when the scrambling module 240scrambles audio data, contents according to speech sensitive to timeorder may be imperceptible. That is, the contents according to thespeech becomes ambiguous in the audio data. Therefore, in the case ofreproducing the audio data later in the electronic device 100 or theexternal device 102, 104, the contents according to the speech of theaudio data may not be precepted by a listener. Meanwhile, theenvironmental sound does not include information sensitive to timeorder. Therefore, although the audio data is scrambled, theenvironmental sound is still perceptible by the listener.

The scrambling module 240 according to an example embodiment acquires atime interval (ΔT) for scrambling using an HOTP algorithm that uses ahash-based message authentication code. However, it is provided as anexample only for clarity of description. An algorithm used to performscrambling according to the present disclosure is not limited to theHOTP algorithm.

Hereinafter, a process of performing scrambling in the scrambling module240 is further described.

To generate a time interval (ΔT) for scrambling, a controller 240 a ofthe scrambling module 240 stores a secret key 240 c to be input to ahash function unit 240 d and a counter 240 b for counting a number ofiterations, and updates the counter 240 b and the secret key 240 c inresponse to occurrence of an event. In detail, the controller 240 aupdates the counter 240 b every time the hash function unit 240 doutputs the time interval (ΔT) for scrambling and updates the secret key240 c in response to occurrence of an event requiring updating of thesecret key 240 c. Updating of the secret key 240 c may be performed bythe controller 240 a if a valid period of the secret key 240 c expires,or in response to a request from an external authorized authenticationserver for updating the secret key 240 c. Here, updating of the secretkey 240 c may be performed in response to receiving a new secret keyfrom the external authentication server through the communication module130 connected to the network 190 or in response to receiving the newsecret key from the external device 102 connected through the connectionterminal 120. Also, if the secret key 240 c of the scrambling module 240a is updated, a secret key 750 c stored in a descrambling module 750,which is described below, may need to be updated. The time interval (ΔT)for scrambling generated by the hash function unit 240 d according tothe present disclosure may represent a length of audio data to bescrambled and may, generally, be a numeric value. For example, if thetime interval (ΔT) output from the hash function unit 240 d is 10,scrambling may be performed based on a unit of 10. This unit may be asample unit, a bit unit, or a time unit.

The controller 240 a of the scrambling module 240 stores scramblingrelated information, such as, for example, a hash function, an HOTPvalue length, and a sorting algorithm, in addition to the secret key 240c and the counter 240 b. The hash function is stored in the hashfunction unit 240 d, and the hash function unit 240 d inputs the counter240 b and the secret key 240 c to the hash function under control of thecontroller 240 a and outputs a result thereof to a scrambler 240 e asthe time interval (ΔT). Here, since the counter 240 b is a valueacquired by counting a number of times that the time interval (ΔT) isgenerated by the hash function unit 240 d, the hash function unit 240 dmay generate the time interval (ΔT) using only the secret key 240 c.

Also, the counter 240 c is updated every time the input audio data isscrambled every time interval (ΔT) and thus, may represent a scramblinginterval of the input audio data. Therefore, the controller 240 a or theprocessor 180 may directly access a scrambling section desired to seekin the entire scrambled audio data, through the counter value. In thismanner, a time for seeking a desired section in the entire audio datasection may be reduced.

The scrambling related information may be prestored in the scramblingmodule 240, and may be received and stored by the processor 180 throughthe communication module 130 connected to the network 190. Basedthereon, the scrambling module 240 may acquire the time interval (ΔT)from the counter 240 b and the secret key 240 c using the hash functionas shown in FIG. 2B, and may scramble audio data based on the acquiredtime interval (ΔT). Here, the secret key and the hash function, thecounter, and the HOTP value length may also need to be stored alike inthe descrambling module 750 of FIG. 7 configured to descramble the audiodata scrambled by the scrambling module 240. Although FIG. 2B describesthat the counter 240 b and the secret key 240 c are input to the hashfunction unit 240 d to output the time interval (ΔT), the hash functionunit 240 d may also output the time interval (ΔT) using the secret key240 c alone. Herein, since the counter 240 b is a value counted everytime the time interval (ΔT) is generated by the hash function unit 240d, the electronic device 100 may also determine a portion correspondingto a location of current audio data to be scrambled in the entire audiodata based on the counter value.

Referring to FIG. 3, audio data of the time interval (ΔT) may include aplurality of audio samples discriminated from each other in a timedomain. For example, the audio data may include n audio samples and theaudio samples may be arranged in temporal order in which the respectiveaudio samples are acquired. Through this, referring to FIG. 4A or 4B,the scrambling module 240 may scramble audio samples in the time domain.That is, the scrambling module 240 may rearrange the audio samples inthe time domain. For example, referring to FIG. 4A, the scramblingmodule 240 may scramble the audio samples in order arbitrarilydetermined by an algorithm. As another example, referring to FIG. 4B,the scrambling module 240 may scramble the audio samples in reverse timeorder. In detail, the scrambler 240 e of the scrambling module 240 mayarrange audio data samples of the time interval (ΔT) in non-time orderusing a predetermined sorting algorithm.

To this end, referring to FIG. 5, the scrambling module 240 may includea buffer 543. For example, referring to FIG. 5, the buffer 543 mayinclude a plurality of storage areas, and the scrambling module 240 maystore audio data in the buffer 543 over time. Here, the scramblingmodule 240 may acquire each of audio samples over time and may store theaudio samples in the storage areas of the buffer 543, respectively, andmay also scramble the audio samples through the predetermined sortingalgorithm, as shown in FIG. 4A or 4B.

The audio compression module 250 may compress the audio data.

The combination module 260 may combine the video data and the audiodata. Here, the combination module 260 may combine the video data andthe audio data based on the predetermined time interval (ΔT). Forexample, the combination module 260 may include a multiplexer (MUX). Thecombination module 260 may store the video data and the audio datatogether in the memory 170. Here, the combination module 260 may delay astart point in time of the video data by the time interval (ΔT) used bythe scrambling module 240, may synchronize a start point in time ofscrambled audio data and the start point in time of the video data, andmay thereby store the video data and the audio data together.

The video data and the scrambled audio data compressed in the processor180 may be combined by the combination module 260 and then transmittedto an external server connected to a wireless network through thecommunication module 130.

FIG. 6 is a flowchart illustrating an operating method of the electronicdevice 100 according to an example embodiment.

Referring to FIG. 6, in operation 610, the electronic device 100 mayacquire video data and audio data. The processor 180 may acquire thevideo data through the camera module 110 and, here, acquire the audiodata through the input module 140. Here, the video processing module 210may process the video signal collected through the camera module 110and, through this, the video data may be acquired. Meanwhile, the audioprocessing module 230 may acquire the audio signal collected through theinput module 140 and, through this, the audio data may be acquired. Inoperation 620, the electronic device 100 may scramble the audio data innon-time order. If the audio data includes speech and environmentalsound, contents according to the speech becomes ambiguous in the audiodata as the audio data is scrambled. Therefore, when reproducing theaudio data later in the electronic device 100 or the external device102, 104, the contents according to the speech of the audio data isimperceptible by a listener. Meanwhile, the environmental sound does notinclude contents sensitive to the time order. Therefore, although theaudio data is scrambled, the environmental sound is still perceptible bythe listener.

According to various example embodiments, the scrambling module 240 mayscramble audio data. According to an example embodiment, the scramblingmodule 240 may scramble audio data based on a predetermined timeinterval (ΔT). According to another example embodiment, the scramblingmodule 240 may scramble audio data based on a varying time interval(ΔT). The scrambling module 240 may make it difficult to find out acorresponding time interval (ΔT) at any point in time by changing thetime interval (ΔT) for scrambling in non-time order using an OTPgeneration algorithm that outputs unique numerical values generatedbased on a secret key, such as an HOTP algorithm.

In detail, the scrambling module 240 stores scrambling relatedinformation, such as, for example, a hash function and a secret key tobe used for scrambling of the time interval (ΔT), a counter for countinga number of iterations, and an HOTP value length. The scrambling relatedinformation may be prestored in the scrambling module 240, and may bereceived and stored by the processor 180 through the communicationmodule 130 connected to the network 190. Based thereon, referring toFIG. 2B, the scrambling module 240 may acquire the time interval (ΔT)from the counter 240 b and the secret key 240 c using the hash function,and may scramble audio data using the acquired time interval (ΔT). Here,the secret key and the hash function, the counter, and the HOTP valuelength need to be stored alike even in the descrambling module 750 ofFIG. 7 configured to descramble the information descrambled by thescrambling module 240.

Referring to FIG. 3, audio data of the time interval (ΔT) may include aplurality of audio samples separate from each other in a time domain.For example, the audio data may include n audio samples, and the audiosamples may be arranged in order of times at which the respective audiosamples are acquired. Through this, referring to FIG. 4A or 4B, thescrambling module 240 may scramble the audio samples in the time domain.That is, the scrambling module 240 may rearrange the audio samples inthe time domain. For example, as shown in FIG. 4A, the scrambling module240 may scramble the audio samples in arbitrary order. As anotherexample, as shown in FIG. 4B, the scrambling module 240 may scramble theaudio samples in reverse time order.

In operation 630, the electronic device 100 may store the video data andthe audio data together. The processor 180 may store the video data andthe audio data together in the memory 170. To this end, the videocompression module 220 may compress the video data, and the audiocompression module 250 may compress the audio data. The combinationmodule 260 may combine the video data and the audio data. Also, thecombination module 260 may store the video data and the audio data inthe memory 170. Here, the combination module 260 may store the videodata and the audio data by synchronizing a start point in time of thevideo data and a start point in time of the scrambled audio data.

FIG. 7A is a diagram illustrating the processor 180 for descramblingscrambled audio data of the electronic device 100 according to variousexample embodiments. FIG. 7B is a diagram describing an example of thedescrambling module 750 of FIG. 7A.

Referring to FIG. 7A, the processor 180 may include at least one of adetection module 710, a video decompression module 720, a video playbackmodule 730, an audio decompression module 740, the descrambling module750, and an audio playback module 760. In some examples, at least one ofcomponents of the processor 180 may be omitted, and at least one anothercomponent may be added. In some examples, at least two of the componentsof the processor 180 may be configured as a single integrated circuit.

The detection module 710 may detect each of video data and audio data.Here, the detection module 710 may separate combined video data andaudio data. For example, the detection module 710 may include ademultiplexer (DeMUX). According to an example embodiment, the detectionmodule 710 may acquire the combined video data and audio data from thememory 170 and may detect each of the video data and the audio data fromthe combined video data and audio data. According to another exampleembodiment, the detection module 710 may receive the combined video dataand audio data through the communication module 130 and may detect eachof the video data and audio data from the combined video data and audiodata.

The video decompression module 720 may decompress the video data.

The video playback module 730 may reproduce the video data. Here, thevideo playback module 730 may output the video data through the outputmodule 150. For example, the video playback module 730 may reproduce thevideo data through a display module.

The audio decompression module 740 may decompress the audio data. Here,the decompressed audio data may be in a scrambled state.

The descrambling module 750 may descramble the scrambled audio data.According to an example embodiment, the descrambling module 750 maydescramble the scrambled audio data based on the time interval (ΔT)predetermined for scrambling the audio data. According to anotherexample embodiment, the descrambling module 750 may descramble thescrambled audio data based on the varying time interval (ΔT). Thedescrambling module 750 may find out the corresponding time interval(ΔT) for scrambling in non-time order at any point in time using an OTPgeneration algorithm that outputs unique values generated based on asecret key, such as an HOTP algorithm. In this manner, when thedescrambling module 750 descrambles the scrambled audio data, audiosamples within the corresponding time interval (ΔT) may be returned fromnon-time order to time order.

The descrambling module 750 according to an example embodiment mayacquire a time interval (ΔT) to which scrambling is applied using anHOTP algorithm using a hash-based message authentication code. However,it is provided as an example only and an algorithm used to performdescrambling according to the present disclosure is not limited to theHOTP algorithm.

Hereinafter, a process of performing, by the descrambling module 750,descrambling is further described.

For descrambling of the time interval (ΔT), a controller 750 a of thedescrambling module 750 stores a secret key 750 c to be used by a hashfunction unit 750 d and a counter 750 b for counting a number ofiterations, and updates the secret key 750 c and the counter 750 b inresponse to occurrence of an event. In detail, the controller 750 aupdates the counter 750 b every time the hash function unit 750 dupdates the time interval (ΔT) for descrambling and updates the secretkey 750 c in response to occurrence of an event requiring updating ofthe secret key 750 c. Updating of the secret key 750 c may be performedby the controller 750 a if a valid period of the secret key 750 cexpires, or in response to a request from an external authorizedauthentication server for updating the secret key 750 c. Here, updatingof the secret key 750 c may be performed in response to receiving a newsecret key from the external authentication server through thecommunication module 130 connected to the network 190 or receiving thenew secret key from the external device 102 connected through theconnection terminal 120.

If the secret key 240 c of the scrambling module 240 is updated, theexternal authorized authentication server may inform the descramblingmodule 750 of secret key updating of the scrambling module 240 throughthe communication module 130 and may transmit the updated secret key tothe descrambling module 750. If the updated secret key is received, thecontroller 750 a of the descrambling module 750 may update the existingsecret key 750 c with the new secret key and thereby store the newsecret key. Therefore, the electronic device 100 according to thepresent disclosure may allow the secret key 240 c of the scramblingmodule 240 and the secret key 750 c of the descrambling module 750 tohave the same information at all times.

The controller 750 a of the descrambling module 750 stores scramblingrelated information, such as a hash function, a HOTP value length, and asorting algorithm. The hash function is stored in the hash function unit750 d, and the hash function unit 750 d inputs the counter 750 b and thesecret key 750 c to the hash function under control of the controller750 a and outputs a result thereof to a descrambler 750 e as the timeinterval (ΔT). Here, since the counter 750 b is a value acquired bycounting a number of times that the time interval (ΔT) is generated bythe hash function unit 750 d, the hash function unit 750 d may generatethe time interval (ΔT) using only the secret key 750 c.

Also, the counter 750 c is updated every time the scrambled audio datais descrambled every time interval (ΔT) and thus, may represent adescrambling interval of the scrambled audio data. Therefore, thecontroller 750 a or the processor 180 may directly access an audiosection desired to seek in the entire scrambled audio data ordescrambled audio data, through the counter value. In this manner, atime for seeking a desired section in the entire audio data section maybe reduced.

The descrambler 750 e of FIG. 7 may restore the audio data by performingdescrambling using the same sorting algorithm as that used in thescrambler 250 e of FIG. 2 based on a unit of the time interval (ΔT) withrespect to the input scrambled audio data. Therefore, the scramblingmodule 240 and the descrambling module 750 may share information about amethod used to sort audio samples in a unit of the time interval (ΔT).

The scrambling related information may be prestored in the descramblingmodule 750, and may be received and stored by the processor 180 throughthe communication module 130 connected to the network 190. Basedthereon, the hash function unit 750 d of the descrambling module 750 mayacquire the time interval (ΔT) from the counter 750 b and the secret key750 c using the hash function, and may descramble the scrambled audiodata based on the acquired time interval (ΔT). Here, the secret key andthe hash function, the counter, and the HOTP value length, and sortingalgorithm information also need to be stored alike in the scramblingmodule 240 having performed scrambling of the scrambled audio data.

The scrambled audio data of the time interval (ΔT) may include aplurality of audio samples discriminated from each other in a timedomain. For example, referring to FIG. 4A or 4B, the scrambled audiodata of the time interval (ΔT) may include scrambled n audio samples andthe audio samples may be scrambled in in non-time order. For example,referring to FIG. 4A, the audio samples may be scrambled in orderarbitrarily determined by an algorithm. As another example, referring toFIG. 4B, the audio samples may be scrambled in reverse time order.Through this, the descrambling module 750 may descramble the audiosamples in the time domain as shown in FIG. 3. That is, the descramblingmodule 750 may rearrange the audio samples in the time domain. Throughthis, the audio samples may be arranged in time order.

The audio playback module 760 may reproduce the audio data. Here, theaudio playback module 760 may output the audio data through the outputmodule 150. For example, the audio playback module 760 may output theaudio data through an audio output module. Here, contents according tospeech as well as the environmental sound in the audio data isperceptible by the listener.

FIG. 8 is a flowchart illustrating an operating method of the electronicdevice 100 according to various example embodiments.

Referring to FIG. 8, in operation 810, the electronic device 100 mayacquire scrambled audio data. The processor 180 may detect each of thevideo data and audio the data. According to an example embodiment, theprocessor 180 may acquire the combined video data and audio data fromthe memory 170, and may detect each of the video data and the audio datafrom the combined video data and audio data. According to anotherexample embodiment, the processor 180 may receive the combined videodata and audio data through the communication module 1130 and may detecteach of the video data and the audio data from the combined video dataand audio data. To this end, the detection module 710 may separate thecombined video data and audio data. The video decompression module 720may decompress the video data. Also, the audio decompression module 740may decompress the audio data. Here, the decompressed audio data may bein a scrambled state.

In operation 820, the electronic device 100 may descramble the scrambledaudio data. As the scrambled audio data is descrambled, the contentsaccording to speech as well as the environmental sound in the audio datamay be perceptible.

According to various example embodiments, the descrambling module 750may descramble the scrambled audio data. According to an exampleembodiment, the descrambling module 750 may descramble the scrambledaudio data based on the time interval (ΔT) predetermined for scramblingthe audio data. According to another example embodiment, thedescrambling module 750 may descramble the scrambled audio data based onthe varying time interval (ΔT). The descrambling module 750 may find outthe corresponding time interval (ΔT) for scrambling in non-time order atany point in time using an OTP generation algorithm that outputs uniquevalues generated based on a secret key, such as an HOTP algorithm. Inthis manner, when the descrambling module 750 descrambles the scrambledaudio data, audio samples within the corresponding time interval (ΔT)may be returned from non-time order to time order.

In detail, the descrambling module 750 stores scrambling relatedinformation, such as, for example, a secret key and a hash function tobe used for descrambling of the time interval (ΔT), a counter forcounting a number of iterations, an HOTP value length, and sortingalgorithm information. The scrambling related information may beprestored in the descrambling module 750 and may be received and storedby the processor 180 through the communication module 130 connected tothe network 190. Based thereon, referring to FIG. 7, the descramblingmodule 750 may acquire the time interval (ΔT) from the counter 750 b andthe secret key 750 c using the hash function and may descramble thescrambled audio data using the acquired time interval (ΔT). Here, thesecret key and the hash function, the counter, the HOTP value lengthneed to be stored alike in the scrambling module 240 having performedscrambling of the scrambled audio data.

The scrambled audio data of the time interval (ΔT) may include aplurality of audio samples discriminated from each other in the timedomain. For example, referring to FIG. 4A or 4B, the scrambled audiodata of the time interval (ΔT) may include scrambled n audio samples andthe audio samples may be scrambled in in non-time order. For example,referring to FIG. 4A, the audio samples may be scrambled in orderarbitrarily determined by an algorithm. As another example, referring toFIG. 4B, the audio samples may be scrambled in reverse time order.Through this, the descrambling module 750 may descramble the audiosamples in the time domain as shown in FIG. 3. That is, the descramblingmodule 750 may rearrange the audio samples in the time domain. Throughthis, the audio samples may be arranged in time order.

In operation 830, the electronic device 100 may reproduce the audiodata. Here, the audio playback module 760 may output the audio datathrough the output module 150. For example, the audio playback module760 may output the audio data through the audio output module. Here,contents according to speech as well as the environmental sound in theaudio data is perceptible by the listener. According to an exampleembodiment, while the video playback module 730 is outputting the videodata, the audio playback module 760 may reproduce the audio data.

The electronic device 100 according to various example embodiments mayinclude the camera module 110 configured to collect a video signal, theinput module 140 configured to collect an audio signal while the videosignal is being collected, and the processor 180 configured to connectto the camera module 110 and the input module 140.

According to various example embodiments, the processor 180 may beconfigured to acquire video data and audio data, to scramble the audiodata in non-time order, and to store the video data and the scrambledaudio data together.

According to various example embodiments, the processor 180 may includethe scrambling module 240 configured to scramble the audio data innon-time order every time interval (ΔT).

According to various example embodiments, the time interval (ΔT) may bea length of the scrambled audio data.

According to various example embodiments, the time interval (ΔT) mayvary using an algorithm that generates a series of numerical valuesusing a secret key. For example, the scrambling module 240 may beconfigured to acquire the time interval (ΔT) from the secret key using ahash function, according to the algorithm. Here, at least one of thehash function and the secret key may be prestored in the scramblingmodule 240, or may be received from an outside and stored in thescrambling module 240. Meanwhile, at least one of the hash function andthe secret key may be shared with the descrambling module 750 configuredto descramble the scrambled audio data.

According to various example embodiments, the processor 180 maysynchronize a start point in time of the video data with a start pointin time of the scrambled audio data and may store the video data and thescrambled audio data together.

According to various example embodiments, the scrambling module 240 mayscramble audio samples in the audio data of the time interval innon-time order arbitrarily determined in an algorithm. Here, thearbitrarily determined non-time order may be shared with thedescrambling module 750 configured to descramble the scrambled audiodata.

According to various example embodiments, the processor 180 may furtherinclude the video processing module 210 configured to process the videosignal collected from the camera module 110 to the video data, the audioprocessing module 230 configured to process the audio signal collectedfrom the input module 140 to the audio data, the audio compressionmodule 250 configured to compress the scrambled audio data, and thevideo compression module 220 configured to compress the video data.

An operating method of the electronic device 100 according to variousexample embodiments may include acquiring video data and audio data,scrambling the audio data in non-time order, and storing the video dataand the scrambled audio data together.

According to various example embodiments, the scrambling of the audiodata in non-time order may include scrambling the audio data in non-timeorder at time intervals (ΔT).

According to various example embodiments, the time interval (ΔT) may bea length of the scrambled audio data.

According to various example embodiments, the time interval (ΔT) mayvary using an algorithm that generates a series of numerical valuesusing a secret key. For example, the scrambling of the audio data of thetime interval (ΔT) in non-time order may include acquiring the timeinterval (ΔT) from the secret key using a hash function, according tothe algorithm, and scrambling the audio data of the time interval (ΔT)in non-time order. Here, at least one of the hash function and thesecret key may be prestored in the electronic device 100, or may bereceived from an outside and stored in the electronic device 100.Meanwhile, at least one of the hash function and the secret key may beshared with the descrambling module 750 configured to descramble thescrambled audio data.

According to various example embodiments, the storing of the video dataand the scrambled audio data together may include synchronizing a startpoint in time of the video data with a start point in time of thescrambled audio data and storing the video data and the scrambled audiodata together.

According to various example embodiments, the scrambling of the audiodata of the time interval (ΔT) in non-time order may include scramblingaudio samples in the audio data of the time interval (ΔT) in non-timeorder arbitrarily determined in an algorithm, and the arbitrarilydetermined non-time order may be shared with a descrambling moduleconfigured to descramble the scrambled audio data.

According to various example embodiments, the storing of the video dataand the scrambled audio data together may include compressing thescrambled audio data, compressing the video data, and storing thecompressed audio data and the compressed video data together.

According to various example embodiments, the electronic device 100 mayscramble audio data such that contents of speech may not be perceivedand the environmental sound may be perceived from the audio data.According to an example embodiment, the electronic device 100 may makethe contents according to speech become ambiguous in the audio data byscrambling the audio data in non-time order. Therefore, when reproducingthe video data and the audio data later in the electronic device 100 orthe external device 102, 104, the contents according to the speech ofthe audio data may be imperceptible by a listener. Meanwhile, theenvironmental sound does not include contents according to time order.Therefore, as long as a frequency does not significantly vary, theenvironmental sound is still perceptible by the listener although theaudio data is scrambled in the aforementioned manner.

Here, the electronic device 100 may scramble audio data of the timeinterval (ΔT). According to an example embodiment, the time interval(ΔT) may be fixed to be the same with respect to continuous audio data.According to another example embodiment, the time interval (ΔT) may varyusing a function of receiving a secret key and order and outputting aunique value, such as an HOTP algorithm. In this case, for descramblingthe scrambled audio data such that contents of speech as well asenvironmental sound may be perceived, a time interval (ΔT) in whichscrambling in non-time order is performed at a corresponding audio datalocation is found through a function and a secret key used to determinethe same and audio samples within the corresponding time interval (ΔT)need to be returned from non-time order to time order.

FIG. 9 illustrates a vehicle to which the electronic device 100according to various example embodiments is mounted, and FIG. 10illustrates the electronic device 100 of FIG. 9.

Referring to FIGS. 9 and 10, a control device 2100 (e.g., the electronicdevice 100 of FIG. 1) according to various example embodiments may bemounted to a vehicle. Here, the vehicle may be an autonomous vehicle2000.

According to various example embodiments, the control device 2100 mayinclude a controller 2120 that includes a memory 2122 (e.g., the memory170 of FIG. 1) and a processor 2124 (e.g., the processor 180 of FIG. 1),a sensor 2110 (e.g., the sensor module 160 of FIG. 1), a wirelesscommunication device 2130 (e.g., the communication module 130 of FIG.1), a LIDAR device 2140 (e.g., the sensor module 160 of FIG. 1), and acamera module 2150 (e.g., the camera module 110 of FIG. 1).

According to various example embodiments, the controller 2120 may beconfigured at a time of manufacture by a manufacturing company of thevehicle or may be additionally configured to perform an autonomousdriving function after manufacture. Alternatively, a configuration tocontinuously perform an additional function by upgrading the controller2120 configured at the time of manufacture may be included.

The controller 2120 may forward a control signal to the sensor 2110, anengine 2006, a user interface (UI) 2008, the wireless communicationdevice 2130, the LIDAR device 2140, and the camera module 2150, whichare included as other components in the vehicle. Although notillustrated, the controller 2120 may forward a control signal to anacceleration device, a braking system, a steering device, or anavigation device involved with driving of the vehicle.

According to various example embodiments, the controller 2120 maycontrol the engine 2006. For example, the controller 2120 may sense aspeed limit of a road on which the autonomous vehicle 2000 is drivingand may control the engine 2006 such that a driving speed may not exceedthe speed limit, or may control the engine 2006 to increase the drivingspeed of the autonomous vehicle 2000 within the range of not exceedingthe speed limit. Additionally, when sensing modules 2004 a, 2004 b, 2004c, and 2004 d sense an external environment of the vehicle and forwardthe same to the sensor 2110, the controller 2120 may receive the same,may generate a signal for controlling the engine 2006 or a steeringdevice (not shown), and thereby control driving of the vehicle.

When another vehicle or an obstacle is present in front of the vehicle,the controller 2120 may control the engine 2006 or the braking system todecrease the driving speed and may also control a trajectory, a drivingroute, and a steering angle in addition to the speed. Alternatively, thecontroller 2120 may generate a necessary control signal based onrecognition information of other external environments, such as, forexample, a driving lane, a driving signal, etc., of the vehicle, and maycontrol driving of the vehicle.

The controller 2120 may also control driving of the vehicle bycommunicating with a peripheral vehicle or a central server in additionto autonomously generating the control signal and by transmitting aninstruction for controlling peripheral devices based on the receivedinformation.

Further, when a location or an angle of view of the camera module 2150is changed, it may be difficult for the controller 2120 to accuratelyrecognize a vehicle or a lane. To prevent this, the controller 2120 maygenerate a control signal for controlling a calibration of the cameramodule 2150. Therefore, the controller 2120 may generate a calibrationcontrol signal for the camera module 2150 and may continuously maintaina normal mounting location, direction, angle of view, etc., of thecamera module 2150 regardless of a change in the mounting location ofthe camera module 2150 by a vibration or an impact occurring due to amotion of the autonomous vehicle 2000. When prestored information aboutan initial mounting location, direction, and angle of view of the cameramodule 2150 differs from information about the initial mountinglocation, direction, and angle of view of the camera module 2120 that ismeasured during driving of the autonomous vehicle 2000 by a threshold ormore, the controller 2120 may generate a control signal for thecalibration of the camera module 2150.

According to various example embodiments, the controller 2120 mayinclude the memory 2122 and the processor 2124. The processor 2124 mayexecute software stored in the memory 2122 in response to the controlsignal from the controller 2120. In detail, the controller 2120 maystore, in the memory 2122, data and instructions for scrambling audiodata according to various example embodiments, and the instructions maybe executed by the processor 2124 to perform at least one methoddisclosed herein.

Here, the memory 2122 may include a non-volatile recording mediumexecutable at the processor 2124. The memory 2122 may store software anddata through an appropriate external device. The memory 2122 may includerandom access memory (RAM), read only memory (ROM), hard disc, and amemory device connected to a dongle.

The memory 2122 may at least store an operating system (OS), a userapplication, and executable instructions. The memory 2122 may storeapplication data and arrangement data structures.

The processor 2124 may be a controller, a microcontroller, or a statemachine as a microprocessor or an appropriate electronic processor.

The processor 2124 may be configured as a combination of computingapparatuses. The computing apparatus may be configured as a digitalsignal processor, a microprocessor, or a combination thereof.

Also, according to various example embodiments, the control device 2100may monitor a feature inside and/or outside the autonomous vehicle 2000and may detect a status of the autonomous vehicle 2000 using at leastone sensor 2110.

The sensor 2110 may include at least one sensing module 2004 a, 2004 b,2004 c, and 2004 d. The sensing module 2004 a, 2004 b, 2004 c, and 2004d may be provided at a specific location of the autonomous vehicle 2000based on a sensing purpose. The sensing module 2004 a, 2004 b, 2004 c,and 2004 d may be provided in a lower portion, a rear portion, a frontend, an upper end, or a side end of the autonomous vehicle 2000 and maybe provided to an internal part of the autonomous vehicle 2000, a tier,and the like.

Through this, the sensing module 2004 a, 2004 b, 2004 c, and 2004 d maysense driving information, such as the engine 2006, the tier, a steeringangle, a speed, a vehicle weight, and the like, as internal vehicleinformation. Also, the at least one sensing module 2004 a, 2004 b, 2004c, and 2004 d may include an acceleration sensor, a gyroscope, an imagesensor, a radar, an ultrasound sensor, a LIDAR sensor, and the like, andmay sense motion information of the autonomous vehicle 2000.

The sensing module 2004 a, 2004 b, 2004 c, and 2004 d may receive stateinformation of a road on which the autonomous vehicle 2000 is present,peripheral vehicle information, and feature data about an externalenvironmental state, such as weather, as external information, and maysense a vehicle parameter according thereto. The sensed information maybe stored in the memory 2122 temporarily or in long-term depending onpurposes.

According to various example embodiments, the sensor 2110 may integrateand collect information of the sensing modules 2004 a, 2004 b, 2004 c,and 2004 d for collecting information occurring inside and outside theautonomous vehicle 2000.

The control device 2100 may further include the wireless communicationdevice 2130 (e.g., the communication module 130).

The wireless communication device 2130 is configured to implementwireless communication with the autonomous vehicle 2000. For example,the wireless communication device 2130 enables the autonomous vehicle2000 to communicate with a mobile phone of the user, another wirelesscommunication device 2130, another vehicle, a central device (a trafficcontrol device), a server, and the like. The wireless communicationdevice 2130 may transmit and receive a wireless signal based on awireless communication protocol. The wireless communication protocol maybe WiFi, Bluetooth, Long-Term Evolution (LTE), code division multipleaccess (CDMA), wideband code division multiple access (WCDMA), andglobal systems for mobile communications (GSM). However, it is providedas an example only and the wireless communication protocol is notlimited thereto.

Also, according to various example embodiments, the autonomous vehicle2000 may implement vehicle-to-vehicle (V2V) communication through thewireless communication device 2130. That is, the wireless communicationdevice 2130 may perform communication with another vehicle and othervehicles on the roads through the V2V communication. The autonomousvehicle 2000 may transmit and receive information, such as drivingwarnings and traffic information, through V2V communication and may alsorequest another vehicle for information or may receive a request fromthe other vehicle. For example, the wireless communication device 2130may perform the V2V communication using a dedicated short-rangecommunication (DSRC) device or a celluar-V2V (CV2V) device. Also, inaddition to the V2V communication, vehicle-to-everything (V2X)communication (e.g., communication between a vehicle and an electronicdevice carried by a pedestrian) may be implemented through the wirelesscommunication device 2130.

Also, the control device 2100 may include the LIDAR device 2140. TheLIDAR device 2140 may detect an object around the autonomous vehicle2000 during an operation, based on data sensed using a LIDAR sensor. TheLIDAR device 2140 may transmit the detected information to thecontroller 2120, and the controller 2120 may operate the autonomousvehicle 2000 based on the detection information. For example, when thedetection information includes a vehicle ahead driving at a low speed,the controller 2120 may instruct the vehicle to decrease a speed throughthe engine 2006. Alternatively, the controller 2120 may instruct thevehicle to decrease a speed based on a curvature of a curve in which thevehicle enters.

The control device 2100 may further include the camera module 2150. Thecontroller 2120 may extract object information from an external imagecaptured from the camera module 2150, and may process the extractedobject information using the controller 2120.

Also, the control device 2100 may further include imaging devicesconfigured to recognize an external environment. In addition to theLIDAR device 2140, a radar, a GPS device, a driving distance measurementdevice (odometry), and other computer vision devices may be used. Suchdevices may selectively or simultaneously operate depending onnecessity, thereby enabling a further precise sensing.

The autonomous vehicle 2000 may further include the user interface (UI)2008 for a user input to the control device 2100. The UI 2008 enablesthe user to input information through appropriate interaction. Forexample, the UI 2008 may be configured as a touchscreen, a keypad, and acontrol button. The UI 2008 may transmit an input or an instruction tothe controller 2120, and the controller 2120 may perform a vehiclecontrol operation in response to the input or the instruction.

Also, the UI 2008 may enable communication between an external device ofthe autonomous vehicle 2000 and the autonomous vehicle 2000 through thewireless communication device 2130. For example, the UI 2008 may enableinteraction with a mobile phone, a tablet, or other computer devices.

Further, although various example embodiments describe that theautonomous vehicle 2000 includes the engine 2006, it is provided as anexample only. The autonomous vehicle 2000 may include a different typeof a propulsion system. For example, the vehicle may run with electricenergy, hydrogen energy, or through a hybrid system that is acombination thereof. Therefore, the controller 2120 may include apropulsion mechanism according to the propulsion system of theautonomous vehicle 2000 and may provide a control signal accordingthereto to each component of the propulsion mechanism.

Hereinafter, a configuration of the control device 2100 configured toscramble audio data according to various example embodiments isdescribed with reference to FIG. 10.

The control device 2100 includes the processor 2124. The processor 2124may be a general-purpose single or multi-chip microprocessor, adedicated microprocessor, a microcontroller, a programmable gate array,and the like. The processor 2124 may also be referred to as a centralprocessing unit (CPU). Also, according to various example embodiments,the processor 2124 may be a combination of a plurality of processors2124.

The control device 2100 also includes the memory 2122. The memory 2122may be any electronic component capable of storing electronicinformation. The memory 2122 may include a combination of memories 2122in addition to a unit memory.

According to various example embodiments, data 2122 b and instructions2122 a for scrambling audio data may be stored in the memory 2122. Whenthe processor 2124 executes the instructions 2122 a, the instructions2122 a and a portion or all of the data 2122 b required to perform theinstructions 2122 a may be loaded to the processor 2124 as indicatedwith dotted lines 2124 a and 2124 b.

The control device 2100 may include a transceiver 2130 c including atransmitter 2130 a and a receiver 2130 b, to allow transmission andreception of signals. At least one antenna, for example, antennas 2132 aand 2132 b may be electrically connected to the transceiver 2130 c, thatis, each of the transmitter 2130 a and the receiver 2130 b, and mayinclude additional antennas.

The control device 2100 may also include a digital signal processor(DSP) 2170, and may control the vehicle to quickly process a digitalsignal through the DSP 2170.

The control device 2100 may also include a communication interface 2180.The communication interface 2180 may include at least one port and/orcommunication module configured to connect other devices to the controldevice 2100. The communication interface 2180 may enable interactionbetween the user and the control device 2100.

Various components of the control device 2100 may be connected throughone or more buses 2190, and the one or more buses 2190 may include apower bus, a control signal bus, a state signal bus, and a database bus.The components may forward mutual information through the bus 2190 andmay perform a desired function.

FIG. 11 is a diagram describing operations of a first electronic device1100 configured to generate scrambled audio data, a server 1150, and asecond electronic device 1170 configured to descramble the scrambledaudio data according to various example embodiments.

Referring to FIG. 11, the first electronic device 1100 may be theelectronic device 100 of FIG. 1 and may be mounted to a vehicle. Thesecond electronic device 1170 may be an electronic device, such as asmartphone, a tablet PC, and a desktop of a user, and may descramblescrambled audio data generated by the first electronic device 1100 andmay provide the descrambled audio data to the user. The first electronicdevice 1100 and the second electronic device 1170 may include aconfiguration of the electronic device 100 of FIG. 1. Referring to FIG.11, the server 1150 may connect to the first electronic device 1100 andthe second electronic device 1170 through a wireless network or a wirednetwork, and may manage the same secret key, counter, hash function, andsorting algorithm to be maintained between the two electronic devices1100 and 1170 such that the descrambling module 750 of the secondelectronic device 1170 may successfully descramble the audio datascrambled by the scrambling module 240 of the first electronic device1100. Also, in response to receiving video data and the scrambled audiodata generated by the first electronic device 1100, the server 1150 maynotify the second electronic device 1170 of the same. Here, it isdesirable that the server 1150 may perform an authentication procedurein advance for a user of the second electronic device 1170 for security.If the notified user of the second electronic device 1170 requestsdownloading of the video data and the scrambled audio data generated bythe first electronic device 1100, the server 1150 transmits the videodata and the scrambled audio data to the second electronic device 1170.As described above, when the first electronic device 1150 transmitsscrambled audio data to the server 1150 over the wireless network, atime interval (ΔT) may be determined based on a bandwidth and a datatransmission rate of the wireless network. Also, the user of the firstelectronic device 1100 or the user of the second electronic device 1170may subscribe to a different wireless communication service to upload ordownload video data and/or audio data to the server 1150. A processor ofthe first electronic device 1100 and/or a processor of the secondelectronic device 1170 uploads/downloads video data/audio data based onwireless communication service subscription information of the userstored in a memory. Also, the processor of the first electronic device1100 and/or the processor of the second electronic device 1170 mayupload/download video data/audio data based on a data transmission ratedetermined by scheduling of the server 1150 regardless of the wirelesscommunication service subscription information of the user.

Hereinafter, an example embodiment in which the second electronic device1170 descrambles the scrambled audio data generated by the firstelectronic device 1100 is described from perspective of user experience.

In detail, description is made with assuming a service that provides thesecond electronic device 1170 with the scrambled audio data generated bythe first electronic device 1100 mounted to a vehicle.

Initially, once the first electronic device 1100 mounted to the vehicleconnects to the server 1150, the user of the first electronic device1100 subscribes to a service by inputting at least one of a password,user ID information, and electronic device ID information to the server1150. Herein, the password, the user ID information, and the electronicdevice ID information are referred to as service subscriptioninformation. If the user subscribes to the service, the server 1150generates scrambling related information, such as, for example, a secretkey, a hash function, a counter, sorting algorithm information, and thelike, for scrambling of the audio data and then transmits the generatedscrambling related information to the first electronic device 1100. Theserver 1150 manages the scrambling related information through mappingto the service subscription information of the user.

If the scrambled audio data is generated by the first electronic device1100, the server 1150 may store the scrambled audio data through mappingto the service subscription information of the user. Here, locationinformation at which the scrambled audio data is generated may also bestored.

A process of downloading and installing an application from the server1150 needs to be initially performed for the user of the secondelectronic device 1170 to be provided with the service. If the usercompletes installation of the application in the second electronicdevice 1170 and then inputs at least one of the password, the user IDinformation, and the electronic device ID information to a log-inscreen, the server 1150 may identify that the user of the secondelectronic device 1170 is a user subscribing to the service.

Once authentication of the second electronic device 1170 is completed,the server 1150 verifies whether the scrambled audio data generated bythe first electronic device 1100 is present, and, when the audio data isverified to be present, notifies the second electronic device 1170 ofthe same. If the user of the second electronic device 1170 requests theserver 1150 to provide the scrambled audio data generated by the firstelectronic device 1100, the server 1150 retrieves the scrambled audiodata corresponding to subscription information of the user and thentransmits the scrambled audio data to the second electronic device 1170.Here, the server 1150 may also transmit location information at whichthe scrambled audio data is generated.

The second electronic device 1170 receiving the scrambled audio datafrom the server 1150 performs descrambling using the prestored secretkey, counter, hash function, and sorting algorithm, and provides thedescrambled audio data to the user. Here, the second electronic device1170 may provide the user with location data together when providing thedescrambled audio data, such that the user may verify a location atwhich the scrambled audio data is generated on map data. In detail, thesecond electronic device 1170 may display a visual object, such as anicon, indicating presence of the generated audio data in the locationinformation with the location information at which the audio data isgenerated on the map data, through the output module 150 of FIG. 1. Inresponse to a selection from the user on the object displayed on thedisplayed map data, the second electronic device 1170 may reproduce thegenerated audio data at a location at which the object is displayed.

Also, since the second electronic device 1170 is aware of the timeinterval (ΔT) and counter information about the audio data, a functionthat allows the user to directly access a specific section in the entireaudio data section through a user experience (UE) screen. For example,if the counter information is 6, it indicates that the time interval(ΔT) is generated six times and the second electronic device 1170 maydirectly access a sixth scrambled audio data section. Therefore, aseeking time used to seek the specific scrambled audio data section maybe reduced.

In addition, if it is used by not the user but a third part or aspecific institution (e.g., an automobile manufacturing company, police,firefighting, insurance company, etc.) to verify information aboutincidents, accidents, etc., sufficient inference may be made only withthe environmental sound (brake sound, collision sound, surroundingvehicle horn sound, etc.) occurring in relation to a correspondingincident or accident, without speech data of the user. As describedabove, the environmental sound is less sensitive to time. Therefore,although audio data including speech data and environmental sound dataaccording to an example embodiment of the present disclosure isscrambled, the third party or the institution may sufficiently use thescrambled audio data for verification of the incident or the accidentwithout descrambling the scrambled audio data.

According to still another example embodiment of the present disclosure,in response to occurrence of a specific event, the control device 2100may transmit compressed data of video data acquired through the cameramodule 2150 and scrambled compressed audio data of audio data inputthrough a microphone, to an external third party or institution throughthe communication interface 2180. Here, the specific event may include acase in which a predetermined impact is detected by the sensor module160, a case in which sudden deceleration/quick acceleration occurs, anda case in which a data transmission request instruction is received froman outside through the communication module 130.

Also, according to still another example embodiment of the presentdisclosure, the control device 2100 may control the communicationinterface 2180 to change an upload speed of the compressed video dataand the compressed audio data based on a data transmission rate or abandwidth when transmitting the same to the outside through the wirelessnetwork.

Various example embodiments herein may be implemented as software (e.g.,program) that includes at least one instruction stored in a machine(e.g., the electronic device 100) and a storage medium (e.g., the memory170) readable by the control device 2100. For example, the machine(e.g., the electronic device 100) and the processor (e.g., the processor180 and the processor 2124) of the control device 2100 may call at leastone instruction from among the stored one or more instructions from thestorage medium and may execute the called at least one instruction,which enables a device to operate to perform at least one functionaccording to the called at least one instruction. The at least oneinstruction may include a code generated by a compiler or a codeexecutable by an interpreter. A machine-readable storage medium may beprovided in a form of a non-transitory record medium. Here,“non-transitory” simply indicates that the record medium is a tangibledevice and does not include a signal (e.g., electromagnetic wave). Thisterm does not distinguish a case in which data is semi-permanentlystored and a case in which the data is temporarily stored in the recordmedium.

According to an example embodiment, the methods according to the variousexample embodiments disclosed herein may be included in a computerprogram product and thereby provided. The computer program productrefers to commodity and may be traded between a seller and a buyer. Thecomputer program product may be distributed in a form of a record medium(e.g., compact disc read only memory (CD-ROM)), or may be distributed(e.g., downloaded or uploaded) only or directly through an applicationstore (e.g., PlayStore™) or may be distributed directly or onlinebetween two user devices (e.g., smartphones). In the case of onlinedistribution, at least a portion of the computer program product may beat least temporarily stored in a storage medium readable by a device,such as a server of a manufacturer, a server of the application store,or a memory of a relay server.

The various example embodiments and the terms used herein are notconstrued to limit the technique described herein to specific exampleembodiments and may be understood to include various modifications,equivalents, and/or substitutions. Like reference numerals refer to likeelements throughout. As used herein, the singular forms “a,” “an,” and“the,” are intended to include the plural forms as well, unless thecontext clearly indicates otherwise. Herein, the expressions, “A or B,”“at least one of A and/or B,” “A, B, or C,” “at least one of A, B,and/or C,” and the like may include any possible combinations of listeditems. Terms “first,” “second,” etc., are used to describe variouscomponents and the components should not be limited by the terms. Theterms are simply used to distinguish one component from anothercomponent. When a component (e.g., a first component) is described to be“(functionally or communicatively) connected to” or “accessed to”another component (e.g., a second component), the component may bedirectly connected to the other component or may be connected throughstill another component (e.g., a third component).

The term “module” used herein may include a unit configured as hardware,software, or firmware, and may be interchangeably used with, forexample, the terms “logic,” “logic block,” “part,” “circuit,” etc. Themodule may be an integrally configured part, a minimum unit thatperforms at least function, or a portion thereof. For example, themodule may be configured as an application-specific integrated circuit(ASIC).

According to various example embodiments, each component (e.g., moduleor program) of the aforementioned components may include a singularentity or a plurality of entities. According to various exampleembodiments, at least one component among the aforementioned componentsor operation may be omitted, or at least one another component oroperation may be added. Alternately or additionally, the plurality ofcomponents (e.g., module or program) may be integrated into a singlecomponent. In this case, the integrated component may perform the sameor similar functionality as being performed by a corresponding componentamong a plurality of components before integrating at least one functionof each component of the plurality of components. According to variousexample embodiments, operations performed by a module, a program, oranother component may be performed in parallel, repeatedly, orheuristically, or at least one of the operations may be performed indifferent order or omitted. Alternatively, at least one anotheroperation may be added.

What is claimed is:
 1. An audio data processing method performed by anelectronic device, the audio data processing method comprising:acquiring a time interval for scrambling audio data; and scrambling asection of a length corresponding to the acquired time interval of theaudio data in non-time order.
 2. The audio data processing method ofclaim 1, wherein the scrambling comprises scrambling the audio data innon-time order every time interval.
 3. The audio data processing methodof claim 1, wherein the acquiring comprises determining a predeterminedtime interval as the time interval.
 4. The audio data processing methodof claim 1, wherein the acquiring comprises determining a varying timeinterval as the time interval.
 5. The audio data processing method ofclaim 1, wherein the acquiring comprises acquiring the time interval bydetermining the time interval using a hash function, and the timeinterval is determined based on a unique value output from the hashfunction in response to a secret key being input to the hash function.6. The audio data processing method of claim 5, wherein the secret keyis a one-time password, and the acquiring comprises acquiring the timeinterval using the updated unique value output from the hash functionaccording to the updated secret key every time the secret key isupdated, and the time interval varies every time the secret key isupdated.
 7. The audio data processing method of claim 6, wherein thesecret key is updated in response to expiry of a valid period of thesecret key or a new secret key being received from an externalauthentication server that communicates with the electronic device. 8.The audio data processing method of claim 1, wherein the acquiring andthe scrambling is repeatedly performed.
 9. The audio data processingmethod of claim 8, further comprising: counting a number of times thetime interval is acquired every time the time interval is acquired. 10.The audio data processing method of claim 9, wherein a first timeinterval is acquired as the time interval in response to the acquiringbeing repeated a kth time, the k denoting an integer of 1 or more, thecounting comprises counting the k as the number of times the timeinterval is acquired, and the scrambling comprises scrambling a sectionof a length corresponding to the first time interval of the audio datain non-time order, and the audio data processing method furthercomprises: storing the k in association with the section of the lengthcorresponding to the first time interval of the audio data.
 11. Theaudio data processing method of claim 1, wherein the scramblingcomprises scrambling a section of the audio data in non-time order byrearranging audio samples included in the section of the audio data ofthe length corresponding to the time interval.
 12. An electronic devicefor processing audio data, the electronic device comprising: at leastone processor configured to execute computer-readable instructionsincluded in a memory, wherein the at least one processor is configuredto acquire a time interval for scrambling audio data, and scramble asection of a length corresponding to the acquired time interval of theaudio data in non-time order.
 13. An audio data processing methodperformed by an electronic device, the audio data processing methodcomprising: acquiring scrambled audio data in which a section of alength corresponding to a first time interval of audio data is scrambledin non-time order; acquiring the first time interval for descramblingthe scrambled audio data; and descrambling the scrambled audio data byarranging audio samples that are included in the section and scrambledin non-time order of the scrambled audio data using the acquired firsttime interval and a sorting algorithm for arranging the scrambled audiodata.
 14. The audio data processing method of claim 13, wherein thesorting algorithm corresponds to an algorithm used for rearranging audiosamples included in the section of the length corresponding to the firsttime interval of the audio data in non-time order to scramble the audiodata in non-time order.
 15. The audio data processing method of claim13, wherein the first time interval is acquired from another electronicdevice that generates the scrambled audio data as a predetermined timeinterval.
 16. The audio data processing method of claim 13, wherein theacquiring comprises acquiring the first time interval by determining thefirst time interval using a hash function, and the first time intervalis determined based on a unique value output from the hash function inresponse to an input of the secret key to the hash function.
 17. Theaudio data processing method of claim 16, wherein the secret key isacquired from another electronic device that generates the scrambledaudio data or an external authentication server.
 18. The audio dataprocessing method of claim 17, wherein the secret key is a one-timepassword, and the acquiring comprises acquiring the updated secret keyfrom the other electronic device or the external authentication serverevery time the secret key is updated.
 19. The audio data processingmethod of claim 13, wherein the acquiring and the descrambling isrepeatedly performed.
 20. The audio data processing method of claim 19,further comprising: counting a number of times the time interval isacquired when the first time interval is acquired; and storing thecounted number of times in association with a descrambled section of thescrambled audio data by the descrambling.